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A  THEORY  OF  CONDITIONAL  INFORMATION 
FOR  PROBABILISTIC  INFERENCE 
IN  INTELLIGENT  SYSTEMS: 

III,  MATHEMATICAL  APPENDIX 


ABSTRACT 

This  paper  concludes  the  work  begun  in  Part  I  in  present¬ 
ing  a  coherent  theory  of  conditioning  consistent  with  all  con¬ 
ditional  probability  evaluations.  Part  I  prsented  the  interval 
of  events  approach  to  conditional  events,  while  Part  II  devel¬ 
oped  the  cartesian  product  space  approach.  While  the  former  is 
computationally  feasible  to  implement,  it  lacks  certain  theoret¬ 
ical  properties  -  in  particular,  it  is  non-bool ean  in  nature. 

On  the  other  hand,  the  latter  approach,  while  conceptually  more 
desirable  than  the  former  -  it  leads  to  a  unique  boolean  struc¬ 
ture  -  is  much  more  complicated  from  a  computation-implementation 
viewpoint.  This  paper  presents  the  more  technically  detailed 
results  required  in  the  presentations  of  Parts  I  and  II. 
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OVERVIEW 


This  paper  constitutes  part  III  of  a  series  of  three  papers  on  the  develop¬ 
ment  of  a  theory  of  conditional  information  compatible  with  all  conditional  prob¬ 
ability  evaluations.  The  bulk  of  this  paper  is  a  mathematical  appendix  which 
supplies  the  technical  details  for  the  chief  results  provided  in  Parts  I  and  II. 

In  Parts  I  and  II  of  this  paper,  the  problem  of  modeling  conditional  inform¬ 
ation  compatible  with  all  conditional  probability  evaluations  was  addressed  [1],  [2l 
A  t>pical  problem  is  the  determination  of  the  meaning  of  the  if-then  statements 
"if  b.then  a"  ,  "if  d.then  c“,  as  well  as  the  logical  compound  "if  b.then  a  , 
and, if  d,  then  c",  Md  the  probebility  P(if  b.then  a,  and,  if  d,  then  c),  when 
the  probability  evaluations  of  the  component  if-then  statements  are 

P{if  b,  then  a)  =Pfe|b)  ;  P(if  d,  then  c)  =  P(c|d). 

Hhen  b  =  d,  the  standard  development  of  probability  leads  simply  to 

P(if  b.then  a,  and,  if  b  then  c  )  =  P(ac|b)  i  P(ab-cb|b), 

with  the  natural  identifications 

"if  b,  then  a"-«-^  ab  ;‘'if  b,  then  c"  cb  . 

However,  when  b  d  ,  no  standard  procedure  exists  for  dealing  with  the 
above  and  related  issues.  Call  any  such  if-then  statement  as  above  a*conditional 
event'*  and  the  algebra  that  allows  logically  combining  such  entities  a  "conditional 
event  algebra".  In  general,  there  are  many  such  conditional  event  algebras,  extend¬ 
ing  ordinary  boolean  algebra.  (The  term  "extension"  is  used  carefully  here,  since 
all  unconditional  events  a,b,c,j,^  can  all  be  considered  special  cases  of  condition 
al  events  "if  fl,  then  a",  "if  ft,  then  b",  "if  ft,  then  c",..,  where  ft  is  the  uni¬ 
versal  event.)  All  of  this  leads,  in  turn,  to  the  development  of  conditional 
events  and  conditional  event  algebras  . 

In  Parts  I  and  II,  two  types  of  conditional  events  were  developed,  useful 
in  addressing  the  above  type  of  problem  as  well  as  a  wide  variety  of  other 
problems  that  can  arise  in  intelligent  systems.  The  first  type  (Part  I)  has  an  event 
interval  structure.  Two  leading  calculi— or  conditional  event  algebras  determining 
the  extension  of  the  traditional  boolean  operations  to  this  setting— are  the 
GNW  (Goodman-Nguyen-Walker)  and  SAC  (Schay-Adams-Calabrese) ,  which  are  briefly 
reviewed.  The  new  type  of  conditional  events(  Part  II  -  called  a-type)  arises 
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from  an  infinite  product  construction  over  the  original  sigma-algebra  of  uncon¬ 
ditional  events,  and,  unlike  the  first  type,  they  form  a  proper  subclass  of  the 
carrier  space  -  which  is  here  a  sigma-algebra  -  and  are  ,  in  general,  not  even 
closed  relative  to  the  boolean  operations  of  the  carrier  space.  But,  a  number  of 
of  problems  that  were  not  able  to  be  addressed  by  the  previous  approach  -  in¬ 
cluding  the  higher  order  conditioning  problem  and  the  need  for  a  firm  basis  for 
establishment  of  conditional  random  variables  and  related  concepts  -  can  oe 
successfully  addressed  through  the  latter  approach.  However,  one  of  the  draw¬ 
backs  in  applying  the  new  procedure  is  the  rapidly  increasing  (factorially) 
computational  lengths  required  for  multiple  argument  conjunctions  or  disjunc¬ 
tions,  unlike  the  essentially  linear  growth  rate  corresponding  computations  enjoyed 
by  the  interval  approach.  The  usefulness  of  the  two  conditional  event  approaches 

was  illustrated  through  the  presentation  and  analysis  of  eight  different 
types  of  conditional  information  problems. 

Among  the  open  issues  deriving  from  this  effort,  the  most  important  include: 

1.  Determine  approximations  to  the  product  space  approach  operations  which 
will  retain  accuracy,  but  will  no  longer  be  computationally  intensive. 

2.  Cothplete  characterization  of  optimal  approximations  to  product  space 
approach  operations  via  GNW  and  SAC  conditional  event  algebras. 

3.  Derive  a  universal  property  for  the  product  space  approach,  justifying 
its  form  as  opposed  to  other  possible  candidates. 

4-.  Determine  the  structure  of  the  subalgebra  spanned  by  the  second  type 
(i.e.,  a-type)  of  conditional  events,  relative  to  the  proper-including  stgraa 
algebra. 

Returning  to  Part  I,  thereis  no  question  that  Lewis '  trivial i ty  result  [3]  was 

seen  to  be  the  basic  gui depost  that  forced  the  search  for  conditional  events  and 
their  algebras  to  be  outside  the  basic  boolean  algebra  (or  sigma-algebra)  of 
(unconditional )  events  a,b,c,d,...  Section  A  hereprsents  for  completeness  the 
Lewis  theorem  and  its  proof ;  Section  B  presents  an  alternative  proof,  based  on 
probability  ordering  characterizations  important  also  for  their  applications 
throughout  Part  I  to  the  development  of  conditional  event  algebras. 
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As  stated  before,  the  approach  to  conditional  events  taken  in  Part  I  is 
the  interval  of  events  one,  where  specifically  any  conditional  event  (alb) 
(representing  "if  b,  then  a")  is  identified  with 

£ab,  b*  vab]  =  {xeA:ab<)i(<  b'  vab}. 

Section  C  V»ere  presents  -a  rigorous  argument  for  the  above  form  to  hold  for 
conditional  events.  Although  there  are  many  possibilities  for  conditional  event 
algebras,  as  mentioned  earlier,  the  choices  are  not  really  arbitrary.  In  fact, 

it  can  be  shown  that  for  a  reasonably  large  class  of  conditional  event  algebras 
there  isabijective  relation  between  each  choice  of  a  truth-functional  three¬ 
valued  logic  and  a  conditional  event  algebra  (relative  to  the  interval  of  events 
approach).  Section  D  of  this  appendix  presents  details  of  this  relationship. 

It  is  also  interesting  to  note  that  in  general  extensions  of  probability  measures 
to  condi tonal  event  algebras  do  not  produce  probability  measures  over  these 
algebras  (but  of  course  for  each  fixed  antecedent,  produce  conditional  probabil* 
ity  measures).  Section  E  provides  details  for  this. 

An  alternate  approach  to  conditional  events  and  their  algebras  is  provided 
by  the  cartesian  product  of  spaces  technique.  Section  F  shows  that  as  far  as 
considering  a  product  space  approach,  the  (countable)  infinite  number  of  factors 
(of  actually  the  same  initial  probability  space)  is  necessary:  no  finite  product 

space  will  yield  -Conditional  events.  As  mentioned  previously,  there  is, in  effect, 
a  tra<leoff  between  the  theoretical  soundness  and  computational  efficiency  of  the 
two  basic  approaches  to  conditional  events  and  their  algebras.  For  the  product 
space  approach.  Section  G  provides  general  formulas  for  conjunctions  and  their 
computational  lengths  and  compares  these  quantitatively  with  the  interval  of 
events  approach.  Some  progress  on  characterizing  the  product  space  approach  to 
conditional  events  is  given  in  Section  H.  Finally,  Section  I  of  this  appendix 
shows  how  two  of  the  leading  conditional  event  algebras  for  the  interval  of 
events  approach  yield  natural  approximations  (as  upper  and  lower  bounds  in  a 
tightest  sense,  for  suitable  modifications)  to  the  full  product  space  compu¬ 
tations. 


-4- 


MATHEMATICAL 

APPENDIX 


This  appendix  presents  two  types  of  results:  concise  statements  of  pre¬ 
viously  proven  results,  given  usually  without  proof  here  (unless  the  latter 
illustrates  a  particular  point)  and  full  theorems  and  proofs  for  new  results. 
The  same  convention  for  notation  here  holds  as  in  Parts  I  and  II. 
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A.  Lewis*  Triviality  Result. 

Theorem  1.  (D.  Lewis  i[3]  ) 

Let  (n  ,A)  be  a  measurable  space.  Suppose  A  contains  at  least  some  elements 
a,b  such  that 

0<ab<b<Q.  (1) 

2 

Then,  it  is  impossible  to  find  a  mapping  ijcA  -^A  such  that  for  all  a,b  e  A  , 

P(4.(a.b))  =  P(a|b)  , 

for  all  probability  measures  P:A-*-[0,l]  such  that  P(b)  >  0. 

Proof:  Assume  the  converse  and  choose  a  fixed  pair  a,b  eA  with  (1)  holding 
such  that 

0  <  P(ab)  <  P(b)  <  1  &  P{ab)  A  P(a)-P(b). 

Then,  by  the  assumpifon  and  usual  properties  of  measurable  spaces, 

P(a|b)  =  P(#(a,b))  =  P^(0(a,b))-P(a)  +  p3.{t|»(a,b))-P{a' ) 

»  P3(a|b).p(a)  +  Pg,(a|b)-P(a’) 

=  l*P{a)  +  O.p(a') 

=  P(a)  , 

a  contradiction.  ^ 

B.  Probability  Inequality  aud  Equality  diaracterizationn 

Lewis'  triviality  result  can  also  shown  to  be  derivable  as  a  direct  conse¬ 
quent  of  the  second  of  two  basic  theorems  below  concerning  the  ordering  of 
conditional  probabilities: 

Theorem  2.  (  [41,  Lemma  2,  pp,  48,49) 

Let  a,b,c,d  e  A  with  b,d  ^  0  (A  is  a  boolean  or  sigma-algebra,  as  usual). 
Then,  the  following  two  statements  are  equivalent: 

U)  P(alb)  <  P{cld)  ,  all  prob.  meas.  P:A-^  [0,1]  ,  P(b),P(d)  >  0. 

(ii)  One  of  the  following  disjoint  cases  hold: 

(I)  ab  =  0  , 
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In  which  case 


P(a|b)  =  0  .  an  P:A+t0.1]  , 

(II)  cd  =  d  , 
in  which  case 

P(cld)  =  1  .all  P:A-*-[0,l], 

(III)  0  <  ab  <  cd  &  0  <  c'd<a'b. 

■ 

Theorem  3.  (  [4],  Corollary  1,  p.49) 

Let  a,b,c,d  e  A  ,  b,d  ^  0.  The,  the  following  two  statements  are  equival¬ 
ent; 

(I)  P(a|b)  =  P(c|d)  ,  all  P:A-»-[0.1]  .  P(b),P(d)  >  0. 

(II)  One  of  the  following  disjoint  cases  holds: 

(I)  ab  =  cd  =  0  , 
in  which  case 

P(a|b)  *  P(c|d)  »  0  ,  all  P:A-*-[0,l]  , 

(II)  ab=b^0  &  cd=d^0. 

In  which  case 

P(a|b)  =  P(c(d)  =1  ,  all  P:A-^-[0,l]  , 

(III)  0<ab  =  cd<b  =  d  . 

■ 

Alternative  proof  of  Lewis'  Theorem  ,  using  Theorem  3: 

If  eq.(2)  holds  In  all  P,  then  it  can  be  rewritten  as 

P(i(.(a,b)|n)  =  P(a|b)  ,  all  PtA-  [0,1]  . 

Immediately  applying  Theorem  3,  shows  the  possibilities 

(I)  1»(a,b)  =  ab  =  0 
or 

(II)  <|»(a,b)  =Q  &  ab  =  b 
or 

(III)  0  <0(a,b)  =  ab  <  n  =  b  . 
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But,  claerly,  all  of  the  above  cases  violate  the  hypothesis.  Hence,  a 
contradiction  holds. 

I 

C.  Axiomatic  Derivation  of  Interval  Form  of  Conditioned.  Events 

Conditional  Event  Problem 

Given  measurable  space  (iQ, A)  ,  find  space  A  with  operations  corresponding 
in  some  way  to  ordinary  •,v,{)'  over  A  (and  with  elements  C,fl  corresponding  to 
C,ll  ,  respectively)  and  find  a  mapping  t|;:A  A  such  that 

(Ql)  ♦(a,b)  =  ^(ab,b)  ,  all  a,beA  . 

^  * 

(<)2)  ♦(•,ft):A->A  is  an  injective  isomorphism,  i.e.,  an  imbedding,  with  re¬ 

spect  to  •  ,v,()'  . 

{Q3)  More  generally  than  (Q2),  for  each  be  A,  (r(»,b):A-^A  is  a  homomor¬ 
phism,. 

(Q4)  For  each  probability  measure  P:A-«-[0,l]  ,  there  is  a  function  RtA-^CO,!] 
extending  P  in  the  sense 

P(«(a,b))  =  P(alb)  ,  all  a,beA  ,  P(b)  >  Q 

(QS)  for  any  a,b,c,d  eA  such  that  either  cd  =  0  or  cd  =  d  ,  then 

<(»(a,b}  =  ♦(c,d)  implies  b  =  u  . 

Theorem  4.  (i  [4].',  Chapter  2  ) 

If  the  Conditional  Event  Problem  has  a  solution  relative  to  assuming  prop¬ 
erties  (Ql)-(<)4),  then  for  all  a,b,c,d  eA,  b,d  f  0  , 

(i)  ♦(a,b)  =  0(0,0)  iff  ab  =  cb  . 

(ii)  0{a,b)  =  0(c,d)  iff  Theorem  3  (ii)  holds. 

Let  (n  jA  )  be  a  given  measurable  space  and  define  the  natural  mapping 
2 

nat:  A  A  ,  where  for  all  a,beA, 
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nat(a,b)  =  Ab'  v  ab  =  {xb'  v  ab  :xcA3  =  [ab,b'  v  a]  , 

etc.  (For  background  on  the  role  of  the  natural  mapping,  see  any  basic  text  in 
abstract  algebra  such  as  Burton  [5],  p.l65  et  passim.) 

Define 

A  =  range(nat)  =  {nat(a,b):  a,beA}  , 

and  note  nat(a,b)  e  A/Ab'  ,  boolean  quotient  algebra  generated  by  principal 
ideal  Ab*  =  {xb' :  xeA},  with  all  of  thetsual  coset  operations.  Hence, 

A  =  U  A/Ab*  =  U  A/Ac  . 
beA  CeA 

where  for  each  b  the  coset  operations  are 

nat(a,b)*nat(c,b)  =  nat{ac,b)  , 
nat(a,b)v  nat(c,b)  =  nat(avc,b), 
nat(a,b)‘  =  nat(a'  ,b)  . 

Theorem  5.  (  [4],  chapter  2) 

Let  {n,A)  be  a  measurable  space.  Then: 

9  -V 

(i)  nat:A  -*■  A  furnishes  a  solution  to  the  Conditional  Event  Problem  for 
properties  {Q1)-{Q5),  where,  for  any  prob.  meas.  P:A-»-[0,l]  ,  a,bcA,  P(b)>0, 

Fvnat(a,b))  =  Plajb)  <by  assignment  or  definitior.}. 

(ii)  For  any  space  A  (not  necessarily  nat)  and  i>:A  ■*-A  surjective  satisfying 
at  least  properties  (Q1 ) ,(Q3) ,(Q4) ,(Q5)  of  the  Problem,  then 

i(»(a,b)  =  ip(c,d)  iff  ab  =  cd  &  b  =  d  , 
and  il/  is  in  a  bijective  relation  with  nat. 


Hence,  without  loss  of  generality,  any  ^  satisfying  Theorem  5  is  equival¬ 
ent  to  nat,  and  we  can  now  define  conditional  event  "a  given  b"  or  "if  b,then 
a"  as  nat(a,b),  where  for  purpose  of  brevity,  we  write  nat(a,b)  simply  as  (a|b) 
and  define  (aIa)  =  A  . 
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D.  Three- valued  Logics  2uid'  Conditional  Event  Algebras 


Let  (fl,A  )  be  a  measurable  space.  We  employ  multivariable  notation  here 

a^  *  {a.j , . .  ,a^)  e  A*'  ,  where  a^  e  A  ,  j=1 , . .  ,n  , 

{a|b)  =  ((a^|b^),.,,(a^|b^))  ;  a-b  =  (a^b^ , . .a^b^)  , 

<fr(_aj^)(a))  =  (<j)( a^  I b^ )(  u) , . .  ,<|i(a^(b^)(tij) )  e  {0,u,l  }*'  , 

i  =  (i^,..,i^)  e  {0,a,l}  . 

♦(albj’^i)  =  (♦(a^|b^)-^i^)....*(ajb^)-^(i^)). 

•{a)=  a^*a2*.-  *  a^  and  similarly  for  •  (♦{^)b)'\jj)  , 

ab  ,  if  k=l , 
a‘b  ,  if  lc=0, 
b*  ,  if  lc=u 

using  the  three-valued  indicator  function  form  for  conditional  events  (ajb), 
<>(a|b):fl  -*■  {0,a,l}  ,  where 

fX  ,  If  uc  ab  , 

0  ,  if  aie  a'b, 

u  ,  if  we  b* 

It  is  easily  seen  that  there  is  a  bijection  between  all  such  three-valued  in¬ 
dicator  functions  over  Q  and  (A|A). 

Also,  call  f:(AlA)”->(A| A)  a  generalized  boolean  operation,  if  there  are 
boolean  operations  T.:  A^'^-»-A  such  that 

=  (f^(a-b,^)  I  f^U-b,^)) ,  for  all  (Ajh)  e  (AjA)'^ .  C3) 

With  all  of  the  preliminaries  completed,  we  can  now  state  the  main  result: 

Theorem  6.  (  [4],  section  3.4) 

(i)  For  any  given  generalized  boolean  operation  f :(A|A)'^ -*■  (A|a) ,  there  is  a 
unique  corresponding  three-valued  truth-functional  logical  operation,  say 
(|)(f)  :{0,a,l}'’ -»■  {0,u,l}  ,  such  that  4  is  an  isomorphism  relative  to  f  and  <j>(f)  , 
i.e., 

<(i(f(a,b))(w)  =  ♦(f)(4>(a|b)(w))  ,  all  wen  . 
Specifically,  one  can  construct  ij)(f)  as  follows: 

From  eq.(3),  using  the  normal  disjunctive  form  modified,  there  is  a  unique 
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minimal  index  set  J(f .)  £ such  that 

f.(a*b  .  b)  =  V  (•(.fr(a|b)"^(i))  ,  all  a,b  e  a"  .j=1.2. 

Then,  define  ♦(f)  :{0,a,l} {0,u,l}  by  ,  for  any  ^  e  ’ 

{1  .  if  i  e  J(f^)nJ(f2)  . 

0  .  if  i  e  Jif^) '00(^2)  • 

a  ,  if  i  e  J{f2)'  . 

(ii)  For  any  given  three-valued  truth-functional  operation  t  :{0,a,l}'' -*■  {0,a,l}, 

there  is  a  unique  corresponding  generalized  boolean  operation,  say 

4)  (t)  :(a|A)”^  (A(A)  ,such  that  41  is  an  isomorphism  relative  to  and  t, 

1  .e., 

T(4>Ulb)(aj))  =  4(  4'"\t)U[^) J(a>) ,  all  weQ. 

Specifically,  one  can  construct  4i”^{t)  as  follows: 

First,  define  as  in  eq.(3),  the  two  components  (x)) .  ,  j=l,2. 

(♦‘^(T)Ua-b  ,  b))  =  V  (•U"^(alb)(i)))  ,  all  a,beA"  , 

ieR(h,j)  “ 

where  fh'^d)  t  if  j=l» 

R(h,j)  =^h*^{0,l})  ,  if  j=2  . 

.. 

rinf.Viy,  lot 

♦  ^(T){a|b)  =  ((♦  ^(T))^(a*b,  b)  J(^”^(T))2{a-b,  bj). 

(iii)  The  above  results  show  that  ^  is  an  isomorphism  between  all  truth- 
functionally-defined  three-valued  logics  and  all  conditional  event  algebras 
ith  operations  being  generalized  boolean. 


E.  Non-Exist:ence  ofi  Probability  Measures  Over  the  Conditional 
Event  Extension  of  a  Boolean  Algebra 

Theorem  7, 

Let  (n,A)  be  a  measurable  space  and  pick  a,b,c,d  e  A  with  b,d  f  ®  , 
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S  =  {0;  x./(x.+x.),  X.  i  x.+x.  ,  for  i  , j  distinct  c  {1,2,3}  ;  1  }  . 

*  *  w  •  '  J 

But,  by  choosing,  e.g., 

x^  =  X2  =  X3  =  1/3  , 

S  =  {0,l/2,l/3.2/3,l}  ; 

then^from  above , 

P(a|b)  +  P(c|d)  =  ((l/3)(2/3)  +  (l/3))/(2/3) 

=  5/6 
i  S  . 

Case  3.  bd  /  0  &  abd  =  0 

Construct  P  so  that 

1/2  =  P(ab)  =  P(b)  =  P{cd)  =  P(d)  . 

But,  substituting  into  (2),  if  it  were  true,  yields 

P(a|b)  +  P(cld)  =  1+1  =  2  =  P(e|f), 

an  impossibility. 

Case  4.  bd  /  0  &  bed  =  0 

Proof  here  imitates  that  for  Case  3. 


Corollary  1 . 

Let  Cn,A)  be  a  measurable  space  with  eq.(l)  satisfied  above  for  some 

elements.  Suppose  also  conditions  (Q1)-{Q3)  are  satisfied  relative  to  the 

2 

Conditional  Event  Problem  here.  Suppose  also  that  0:A  -*■  A  is  closed  with 
respect  to  conjunction  and  disjunction  and  that 

mm 

^.{a,b)*i(>(c,d)  =  0  implies  abed  =  0  . 

Then,  even  if  A  were  boolean,  it  is  impossible  for  condition  (Q4)  to  be 
satisfied  when  PiipCA  ) -*■  [0,1]  is  an  actual  probability  measure. 

Proof:  Immediate  from  Theorem  7.  _ 
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F.  No  Finxtie  Producft  Spaoe  Can  Be  Used  To  Model  Condi tJ.onal  Events 
Theorem  8. 

Let  A  be  a  fixed  nontrivial  boolean  algebra.  Then,  for  any  choice  of  a,b  e 
A ,  wi th 

0  <  a  <  b  <  a  ,  (1) 


there  is  no  non-negative  integer  n  and  n  order  polynomial  in  four  variables^ 

4 

f^:»  -+■  S  with  coefficients  e  {-1,0,1}  ,  0  <  i,j,k,t  <  n  ,  where,  for  any 

x,y,z,W  e  K 


0<i 


2  (c 
.j,k,t'  i 


jkt 


x^yJ 


i+j+k+t<n 


is  such  that  for  all  probability  measures  PiA-^[0,l]  with  P(a)  >  0  , 


fn(P(a),P(b),P(a'b),P(b*))  =  P(a|b)  . 

Proof;  Note  first  that  since 

P(a'b)  =  P(b)-P{a)  ;  P(b')  =  l-P(b)  , 


the  above  problem  is  equivalent  to  having  an  n-order  polynomial  in  two  variables 
with  coefficients  c. ^  e  {-1,0,1}  ,  becoming  now 

•  V 

g„(x,y)  =.I,c.j.x^yj  , 
i  >0 

with, for  all  P, 

g„(P(a),P(b))  =  P(a|b)  .  (2) 


Suppose  that  (2)  is  true  for  all  P.  In  light  of  Lemma  0,  [4]  ,  pp. 47-48, 
for  the  numbers  1/3  and  2/3  ,  one  can  find  P  such  that 

P(a)  =  P(a*b)  =  P(b’)  =  1/3  . 


yielding 


P(a|b}  =  (1/3}/((1/3)+(1/3))  =  1/2  . 


Substituting  these  last  two  equations  into  (2)  yields 
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1/2 


J  c^j^(l/3)'-{2/3)j  = 

i  .j 

which,  when  multiplied  by  2*3^”  yields 

2.(  y  c.  .•3^"~^"'**2'^)  =  3^" 
ij 

which  is  impossible,  as  3  to  any  power  cannot  have  an  even  divisor.  Hence,  a 
contradiction  occurs  if  (1)  holds. 


COrollarv 


2. 


There  is  no  finite  sequence  of  finite-sized  experiments  consisting  of  in¬ 
dependent  trials  whose  outcomes  are  edther  a,a'b,b,b'  (assuming  as  before  that 
eq.{l)  holds)  such  that  the  overall  probability  of  success  is  Pla|b). 


Proof:  Use  Theorem  8. 


'  G  .  Multiple  Azrgunieht  Form  for  Conjunction  of  utr Type  Conditional 
Events  and  Their  Conputational  Lengths 

Theorem  9 . 

Let  (  fl,A)  be  a  given  measurable  space  and  construct  as  before  (fl,A)  with 
2  A 

a:  A  ■*  A  ,  etc.  Then,  for  all  a<h  ,  c<d  ,  e<f  ,  all  in  A  : 

a(a,b)*o(c,d)*o(e,f)  ,c 

yyN\> 

=  oCad'f  ,bvdvf)  © aR*  ,dvf)@a(e,f) 
v  a(acf'  ,bvdvf)0a{e,f) 

V  o(ad'f' ,bvdvf)®  a(ce,dvf) 

V  a(ad‘f' ,bvdvf)0 a(ed',dvf)® a(c,d) 

V  o(aed'  ,bvdvf) © o(c,d) 
y  o( cb'f'>bvdvf)®a(eb'  ,bvf)®  o(a,b) 

''  a(ceb'  ,bvdvf)  © o(a,b) 

V  o(cb'f',bvdvf)® a(ae,bvf) 


V  a(cb'  f  ,bvdvf)®  a(af'  ,bvfX^a(e,f) 

V  o(eb'd'  ,bvdvf)®Ts<ad'  ,bvd)@o(c,d) 

V  o(eb'd' ,bvdvf)@a(ac»bvd) 

V  o(eb'd'  ,bvdvf)®  o(b'c,bvd)®  a(a,b) 

V  a(ace,bvdvf). 

(ii)  For  any  probability  measure  P:A-^tO,l],  there  is  the  corresponding 
product  measure  P:A-^  [0,1],  yielding  the  evaluation  of  (i); 
P(o(a,b)*hU.d)*<*(e,f))  by  replacing  in  (i)  each  occurrence  of  a  by  P,  each 
comma  within  each  original  a-term  by  the  conditional  probability  symbol  (•I**). 
®  by  arithmetic  product,  and  v  by  arithmetic  sum. 


Proof:  Define  for  any  a,b  e  A, 


b^x  a 


Then, 


f  a  .  if  j.O  . 

~|bx...xbxa,  if  j=l,2,. 


j  factors 


a(a,b) *0(0, d) *0(0  ,f) 

(  V  (b')^  xa)*{  V  (d’)^xc)»(  V  (f)^  xe) 
i-0  j=0  k=0 


=  V  V  a(b’)'xa).((d’)Jxc).({f')^e)))  .  (1] 

LVi 

^  for  same 

rearrange¬ 
ment  p  rel¬ 
ative  to  nu¬ 
merical  values, 

^counting  ties  • 

By  considering  here  all  13  possible  rearrangements  of  i,j,k  relative  to 
increasing  order,  including  cases  for  equalities,  one  obtains  the  desired 
result.  For  example,  for  the  rearrangement  (j<i<k)  ,  which  gives  rise  to  the 
ninth  term  (from  top  to  bottom)  in. the  expansion  in  part  (i),  note  that  the 
corresponding  term  inside  the  right  hand  v  expression  in  eq.(l)  becomes 

(b'd'f')^x  cb’f  X  (b'f)^’'’"^  X  af  X  xe  . 


For  (ii),  the  probability  evaluation  fol lows , again  as  in  the  two  argument 
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case  In  Part  II  ([2],  Section  4,  maiin  theorem,  (vii)). 


It  is  of  some  interest  to  be  able  to  obtain  the  general  formula  for  the 
conjunction  of  n  a-type  conditional  events: 

Let  be  any  rearrangement  of  ^  =  (Ji»--»3^)  in  numerical  order,  taking 
into  account  ties 


^  ^P(l,l)""%(l.tn,)  ^^p(2.ir**%(2,m2)  ^  jp(r,l)^- '"Jpir.m^) 

so  that 


<  +«» , 


***1  **'2  “  n  . 


Also,  for  any  index  set  K,  let 


Jj  “  {p( J tl ) *  •  •  >p( J >  j“l ^ • tr  * 


j'''*  •  U  ..u  1 


Then,  for  any  a^  <  b^  e  A  , 

•(a(a,b) )  =  o(a|,b^  )* , .  .•dla^.b^^) 


’  a(a,,b.)  =  V  (b*)  xa> 


f?.) 


K  follows  analogous  to  the  case  of  three  arguments, 

•(a(a,b))  »  V  V  Y(p(i))  . 

all  p  ■■ 


where 


Xfixed/ 

T(p(i))  ■  «  (-Uj  )-<-<bj(,)))) 

)cMh*./_  ^p(r-l.l)  jj 

'^r 
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Hence,  taking  disjunctions  over  the  ^n  (3),  from  basic  represen¬ 

tation  for  each  o(a.,b^)  in  (2),  it  follows  that: 

Theorem  10. 

Let  the  same  assumptions  hold  as  above.  Then, 

(i) 

•(a{a,^))  =  V  y(p)  * 
all 
p 

where  for  any  rearrangement  p,  noting  the  dependency  of  the  and  J.  and  r 
on  p  , 

y(p)  =  )))  ,  v{bj(i_i)))  » 

indicating  repetitive  tensor-like  producting  in  the  obvious  way,  noting  its 
reduction  to  an  identity  form  when  r=l . 

(ii)  For  any  probability  evaluation  of  (i)  via  the  product  measure  extension 

?  of  P  ,  P(‘(oU,b))  is  obtained  ,  analogous  to  Theorem  9(ii),  by  replacing 
in  (i)  each  occurrence  of  a  by  P,  each  comma  inside  the  original  o-type  con¬ 
ditional  event  by  conditional  probability  operation  (•!••).  ®  by  .arithmetic 
product,  and  v  by  arithmetic  sum. 


th"  cor.putsticnal  Vingths  rpoa'i rx-d  tc  cbt-i-r.  repeated 

o-type  conditional  event  conjunction  and  disjunction.  First,  recall  (see, 
e.g.,  Abramowitz  &  Stegun  [6],  section  24)  the  total  number  of  ways  to  par¬ 
tition  a  set  of  n  distinct  elements  into  k  non-empty  consonants  is  the  Stirling 
number  of  the  second  kind 

(k) 


=  (1/k!)  J  (-l)'^‘j*(§)-j" 


j=0 


and  the  number  ic(n)  of  possible  distinct  rearrangements  p  of  n  distinct  var¬ 
iable  set  {j^ ,.. ,j^}  , where  ties  are  allowed  and  the  rearrangements  are  rela¬ 
tive  to  increasing  numerical  order,  is 

Kin)  =  ?  S k!  . 
k=l  " 


Hence , 
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(4) 


■<r 


•c(n)  =  I  J  .(-1)'''^-(j)-j”  . 
k=l  j=0 

Using  the  above  results,  one  can  compare  the  computational  lengths  betvfeen 
the  two  leading  conjunction  operation  candidates  (GNW  and  SAC)  for  the  interval 
representation  form  of  conditional  events  with  the  computational  length  for  the 
o-representation  of  conditional  e ventscon junction i 

Theorem  11 . 

Let  (n,A)  be  a  given  measurable  space.  Consider  both  its  interval 
conditional  event  extension  (AjA)  relative  to  GNW  and  SAC  algebras.  Consider 
also  the  product  space  extension  (^,^)  and  the  associated  a-type  conditional 
event  extension  a(A^)  cA  -  Then,  for  any  a ^  <  b^  eA,  j®l,..,n: 

(i)  Number  of  boolean  operations  required  to  compute  P(*(U|b)))  for  GNH  is 

A.  ,  where 
n 

A„  *  5n  . 
n 

(ii)  Number  of  boolean  operations  required  to  compute  P(*((a|b)))  for  SAC  is 
B  ,  where 

"  =  4n  . 

(iii)  Number  pf  boolean  operations  required  to  compute  P(*(a(a,t)))  is  C.  , 

where  - 

ic(n)  <  ^  2n  i:{n)  , 

Proof:  For  (i),  use  the  form 

•((ajb))  =  (•(a)|(*(a))  V  v(a'*b)) 

and  for  (ii),  use  the  form 

•oUlIb)  =  (‘(b*  va)  I  v(b)), 

where  •  is  GNW  conjunction  and  is  SAC  conjunction.  See  Section  3(iii)  [1], 
eq.d)  for  the  two-argument  case  for  GNW  and  Remark  2,  following  eq.(l)  above 
for  the  two-argument  case  for  SAC.  Both  generalize  readily  to  the  multiple 
argument  forms.  ^ 
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H.  Uniqueness  of  BepresenfatJ-on  of  ct-Type  Condlflonal  Events 

.The  closest  we  can  now  come  to  establishing  the  uniqueness  of  the  a-repre- 
sentation  for  conditional  events  is  in  the  following- theorem: 

Theorem  12. 

Given  a  measurable  space  (n.A)  and  infinite  product  space  extension 
with  conditional  event  mapping  ;  consider 

=  a({a^x..xa^  :  eA,  j=l  ,..,r}). 

2 

Let  A,B:A  -^A  be  arbitrary  satisfying 
r 

P{A(a.blB(a,b))  =  P{a|b)  .  all  a,b  e  A,  all  P  . 

2  ^ 

Suppose,  also  that  tj<;A  -*-A  is  such  that 

-1-00  -f<» 

4i(a,b)  =  V  x  c..  ,  (0) 

i=0  j=o 


where  c.^.  =  (a.b) ,B(a,b))  e  A^  ,  for  all  a,b  e  A,  all  i,j=0,l,2...  . 

and  ^  indicates  disjoint  disjunction. 

Then,  the  following  two  statements  are  equivalent: 


c  .  c  {A(a,bVB{a,b),B(3,bV.o'"}  .  all  i ,  j=0,l  ,2, . . . 
'  J 


P(^j<{a,b))  =  P(alb)  ,  all  a,b  e  A  ,  all  .P 


(1) 

(2) 


(ii)  Up  to  relative  factor  space  locations,  ip  is  the  same  formally  as  the  canoni¬ 
cal  expansion  for  a(a,b)  (Part  II,  Section  4,  eq.(6)),  with  a  replaced  by  A{a,b) 
and  b  by  B(a,b) 


^(a,b)  =  (A(a,b)-B(a,b))  v  (B(a,b)’x  A{a,b)*B{a,b)) 

V  {B(a^)'xB(a,b)'x  A(a,b)*B(a,b))  v. . 


(3) 
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More  precisely,  there  is  (uniquely  determined  by  each  choice  of  c. .‘s)  a 

"  w 

sequence  £  =  ^2  distinct  non-neqative  integers  such  that 


A(a,b)-B<a,b) 
'  B(a.b)' 


.  if  j=Si  . 

.  if  3=Sq,s^ ... ,s._^  , 

.  if  j/So,Sp..,s^._^  ,s.  , 


(4) 


for  all  i  ,j  =0,1 ,2, . . . 

Proof:  Given  (ii),  one  clearly  has  the  same  situation  holding  as  in  the  canon¬ 
ical  one  given  in  (3)  ,  up  to  a  fixed  permutation  of  the  relative  locations  of 
A(a,b}'B(a,b}  and  B(a,b)'.  Thus  it  fbllcws(Part  II,eq. (6))  wi th  a  replaced  by  A(a,b), 
b  by  B(a,bJ,  that  (2)  holds.  (That  (  (4)  implies  (1)  is  obvious.).  Hence,  (i) 
hoi  ds . 

Given  (i )  holding,  use  (1)  ,'(2)  and  the  expansion  (o)  with  x=P(A(a,b)* 
B(a,h)),  y=P(B(a,b)')  replacing  P(ab),  P(b'),  respectively: 

+00  +a» 

P(a(b)  =  P(<</(a,b))  =  I  n  P(c^.^)  =  ^  x^i.y'^i 

1=0  j=0  i=0 

+<0 

=  P(A(a,b)|B(a,b))  =  I  ,  (5) 

i=0 


for  alT  a.t  ,  all  ?,  for  sof"c  ncn-nec=t:  ve  integer';  t.  ,  w.  .  Thre ,  r  cr-d  y 

I  t 

can  vary  freely  over  some  domain  and  hence  the  equality  of  the  two  power  series 
in  (5)  implies,  without  loss  of  generality, 

t^=l  ,  w^  =  i  ,  for  i=0,l,2,...  .  (6) 

In  turn,  (6)  implies,  by  first  considering  i=0,  then  i=l,  then  i=2,..., 
using  the  mutual  orthogonality  of  each  disjunction  term,  that  (4)  indeed  holds 
for  some  and  hence  (ii)  holds.  , 

One  can  add  constraints  to  the  assumptions  of  the  last  theorem  and  to  either 
equivalent  form  (i)  or  (ii)  to  eliminate  all  A(a,b)  and  B(a,b)  except  for  the  sim¬ 
plest:  A(a,b)=a,  6{a,b)=b.  For  example,  if  one  assumes  the  modus  ponens  relation 
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i(/(a,b)*b  =  ab  ,  all  a,b  e  A 


and,  e.g. , 


ab<6(a,b)  ,  all  a,b  eA  , 


then  it  easily  is  shown  that  a,b  are  the  smallest  possible  A,B  candidates: 

ab  <  A(a,b)*B(a,b)  ,  b  <  B(a,b),  all  a,b  e  A  . 


Other  than  the  above  result,  little  progress  has  been  made  in  fully  char¬ 
acterizing  a-type  representation.  Of  course,  if  one  could  show,  e.g.,  that 
assumptions  led  to  the  conclusion  that  candidate  conditional  event  form,  say 
y{a,b)  satisfied  the  modus  ponens  condition  in  (1)  (with  y  for  y)  and,  as  well 

y{a,b)*b'  =  b' X  ii(a,b)  ,  (2) 

A  condition  that  is  compatible  always  with  the  independence  relation 

P(y(a,b)-b')  =  P(y(a,b))*P(b')  =  P(a|b).P(b')  ,  all  prob.  P, 

then,  by  the  simple  expansiort 

y(a,b)  =  y(a,b)*b  v  y(a,b)*b'  (3) 

and  reiteratively  using  (2)  and  (3),  one  obtains  the  infinite  sequence  expansion 
ofa(a,b). 


I.  Af^roxlmatxon  of  a -Type  Operations  by  CNVI  and  SAC  Operations 

C()MCid3r  a  ;jcS'’c  ccmpcriscn  botweon  GNi-',  SAC,  end  a-rypj  oparations 

corresponding  to  •  ,  v  ,  ()'  ,  where  (ft, A)  is  a  given  measurable  space,  (ft, A) 

2  ^ 

is  its  infinite  product  extension,  anda:A-»-A  ,  etc.  In  all  of  the  following, 
as  before,  we  use  the  convention  that  refer  to  SAC  conjunction,  dis¬ 

junction,  respectively  ,  and  now,  •i  ,  Vj  refer  to  €NW  conjunction,  disjunction, 
respectively,  with  unsubcripted  •  ,  v  referring  to  o-type  conjunction,  dis¬ 
junction,  respectively.  Finally,  (  )’  refers  to  either  the  common  GNW  and  SAC 
interpretation  or  the  a-type  interpretation  of  complement/negation. 


Theorem  13. 

For  any  a,b,c,d  eA  leading  to  nontrivial  a(a,b)  (i.e.,  ab  0  ,  b  ^  0, 
so  a(a,b)  ^  0  and  ab  ^  b  ,  b  ^  0  ,  so  that  also  a(a,b)  j*ft): 
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(i) 

a{a,b)-i  a(c,d)  <  a(a,b)*a(c,d)  <  a(a,b)*Qa(c,d)  , 
a(a,b)vQ  a(c,d)  <  a(a,b)va{c,d)  <  a{a,b)via(c,d)  , 
where  the  6NW  and  SAC  analogues  for  a-type  conditionals  are: 

a(a  ,b)*i  a(c,-d)  =  a(abcd  ,  a'b  v  c' d  v  bd)  , 
a(a,b)via(c,d}  =  a(ab  v  cd  ,ab  v  cd  v  bd)* 
a(a,b)-^a(c,d)  =  a(abd'  V  cdb'  v  abed  ,  b  v  d)  , 
a{a,b)v^a(c,d)  =  a<ab  v  cd  ,  bvd)  . 

(ii)  The  bounds  by  the  GNW  operations  .given  as  above  are  the  tightest  possible, 
i.e.,  referring  to  Remark  3,  following  the  main  theorem.  Section  4,  for  all 
nontrivial  a-type  conditional  events 

a(a.b)*.^  a(c,d)  =  a(a ,b)*i  a(c,d)  , 

a(a,b)v*  a(c,d)  =  a(a,b)via(c,d)  . 

Proof:  First,  note  from  Section  4,  main  theorem,  part  (iv),  the  f>artial  (lat¬ 
tice)  order  <  for  (A|A)  for  GNW  coincides  with  the  (boolean)  order  stemming 

^  2 

from  A  restricted  to  the  space  of  a-type  conditionals,  a(A  ).  This  implies 

directly  that  the  upper  left  inequality  is  true.  Dually,  because  GNW  and  a-type 
conditionals  botir  form  OeMorgan  systems  for  conjunction,  disjunction,  and  nega¬ 
tion,  roappli cation  of  toe  above  result  then  shows  the  validity  of  the  lower 
right  inequality. 

the  upper  right  inequality  holds' by  inspection  of  the  conjunction  form 
for  SAC  and  that  for  a-type,  showing  the  difference  to  be  in  the  appended  ten¬ 
sor-like  factors  to  the  latter  .(These  factors  are  readily  seen  to  yield  ex¬ 
pressions  <  corresponding  SAC  terms  without  the  tensor  factors.)  Finally, 
since  both  SAC  and  a-type  conjunction  ,  disjunction,  and  negation  form  a 
DeMorgan  system,  the  lower  left  inequality  is  also  valid. 


Wodify  the  definitions  of  •*  and  v*  from  Remark  3,  following  main  theorem 
of  Section  4,  as  follows: 
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a(a,b)'0:<t(c,d)  -  inf  {a(e,f):  a(a,b)-a(c,d)  <  a(e,f),  for  which  Hypothesis(o) 

is  satisfied  }  > 

a<a,b)  0a{c,d)  =  sup  {a(e ,f) :  o(e ,f)  <  a(a,t)  v  o{c,d),for  which  Hypoth€Sis(o) 

is  satisfied} 


«) 


Hypothesis(o) :  any  a,b,<:,d  eA  .  consider  only  o(a,^).  o(c,d)  f  $,q  ,  with 

b-(d'vc)  .  d-<t)*  va)  «J  ;  ef-(d'vc)  f.(d'vc)  ;  ef-(b‘va)  f  f-(b'va)  . 

theorem  14. 

For  any  a,b,c,d  e  A  ,  the  above  modified  upper  optimal  approximation  for 
conjunction  and  lower  approximation  for  disjunction  coincide  with  the  corres¬ 
ponding  SAC  operations-  That  is,  for  all  such  (restricted  )  a,b,c,d  , 


and 


i 


Proof: 


a(a,b)0a(c,d)  =  a(a  ,b)*^  a{c,d) 
a(a.b)(g;[a(c,d)  =  a{a,b)Vja<C,d) . 
Let  e,f  e  A  arbitrary  such  that 


(2) 


a(a,b)*a(c,d)  <  a(e,f). 


(3) 


Using  Hypothesis  (o),  let  P:A^C0,1]  be  any  probability  measure  with 
P(b-*(d' V  c))  >  0  and  denote^as  usual,  the  infinite  product  probabil ity' associ¬ 
ated  with  P  as  R-:A-*-[0,l]  ,  We  then  apply  the  conditional  probability 

(d've)  b^tw  si'viS  OT  evj.(jy,  yicid'irig  (avucr  s'lfTy  li  vying  tne  LHi  ot  (3y 

(seethe  main  theorem,  part(vii).  Section  4)) 


P(abd'  V  abed  |b*(d'vc))  <  P(e|f -(d'v  c))  ,  K) 

for  all  protr.  meas.  P.  Hence,  by  Theorem  2,  Appendix  and  Hypothesis  (o),  the 
only  possibility  is  that  eg. (4)  implies 

abd'  V  abed  <  ef*(d'vc)  <  ef  .  (5) 


Similarly,  by  taking  now  Pjj.(b'va)  applying  its  infinite  product 
extension  to  both  sides  of  (3)  shows,  analogous  to  (4), 


cdb'  V  abed  <  ef-(b'va)  <  ef 


(6) 
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Then,  disjoining  eqs.(s)  and  (6)  gives 


«• 

pa 
I 

abd'  V  cdb’  v  abed  <  ef  .  (7) 

,  Also,  by  eq.(|)  and  Theorem  13<i),  it  follows  that 

^  .  a(a,b)*ia(c,d)  <  a(e,f)  , 

whence  by  Section  3(iii),  eq.<4), 

abed  <  ef  &  e‘f  <  (abcd)'(a'b  v  c'd  v  bd)  =  a'b  v  c'd.  (8) 

Combining  eqs..{7)  and  (8), 

abd'  V  cdb'  v  abed  <  ef  &  e' f  <  a'b  v  c' d  .  (9) 


On  the  other  hand,  consider  the  comparison  of  SAC  conjunction  with  o(e,f): 
By  eq.M)  above  and  again  use  of  eq.(4).  Section  3(iii), 

a(a,b)‘^a(c,d)  <  a{e,f) 
fff 

abd'  V  cdb'  v  abed  <  ef  &  e'f  <  (abd'  v  cdb'  v  abcd)'*(b  v  d) 

=  a'b  V  c'd  .  (11) 

But,  clearly,  eqs.{9)  and  (11)  are  the  same.  Hence,  eq . (TO)  hoi ds .  Since  a(e,f) 
is  also  arbitrary  satisfying  eq.O),  then  by  the  very  definition  for  0  ,  the 
top  equation  of  (2)  holds.  By  a  duality  argument  (using  OeMorgan  relations) 
the  bottom  equation  of  (2)  also  holds. 
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